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Abstract 

We analyze multiuser detection under the assumption that the number of users accessing the channel 
is unknown by the receiver. In this environment, users' activity must be estimated along with any other 
parameters such as data, power, and location. Our main goal is to determine the performance loss caused 
by the need for estimating the identities of active users, which are not known a priori. To prevent a 
loss of optimality, we assume that identities and data are estimated jointly, rather than in two separate 
steps. We examine the performance of multiuser detectors when the number of potential users is large. 
Statistical-physics methodologies are used to determine the macroscopic performance of the detector 
in terms of its multiuser efficiency. Special attention is paid to the fixed-point equation whose solution 
yields the multiuser efficiency of the optimal (maximum a posteriori) detector in the large signal-to-noise 
ratio regime. Our analysis yields closed-form approximate bounds to the minimum mean-squared error 
in this regime. These illustrate the set of solutions of the fixed-point equation, and their relationship 
with the maximum system load. Next, we study the maximum load that the detector can support for a 
given quality of service (specified by error probability). 
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I. Introduction 

In multiple-access communication, the evolution of user activity may play an important role. 
From one time instant to the next, some new users may become active and some existing users 
inactive, while parameters of the persisting users, such as power or location, may vary. Now, 
most of the available multiuser detection (MUD) theory is based on the assumption that the 
number of active users is constant, known at the receiver, and equal to the maximum number of 
users entitled to access the system [1]. If this assumption does not hold, the receiver may exhibit 
a serious performance loss [2], [6]. In [7], the more realistic scenario in which the number of 
active users is unknown a priori, and varies with time with known statistics, is the basis of a 
new approach to detector design. This work presents a large-system analysis of this new type 
of detectors for Code Division Multiple Access (CDMA). 

Our main goal is to determine the performance loss caused by the need for estimating the 
identities of active users, which are not known a priori. In this paper we restrict our analysis 
to a worst-case scenario, where detection cannot improve the performance from past experience 
due to a degeneration of the activity model (for instance, assuming a Markovian evolution of 
the number of active users [3], [4]) into an independent process [5]. The same analysis applies 
to systems where the input symbols accounting for data and activity are interleaved before 
detection. To prevent a loss of optimality, we assume that identities and data are estimated 
jointly, rather than in two separate steps. Our interest is in randomly spread CDMA system in 
terms of multiuser efficiency, whose natural dimensions (number of users K, and spreading gain 
N) tend to infinity, while their ratio (the "system load") is kept fixed. In particular, we consider 
the optimal maximum a posteriori (MAP) multiuser detector, and use tools recently adopted 
from statistical physics [8], [9], [1 1]— [13], [27]. Of special relevance in our analysis is the 
decoupling principle introduced in [9] for randomly spread CDMA. The general results derived 
from asymptotic analysis are validated by simulations run for a limited number of users [12]. 

The results of this paper focus on the degradation of multiuser efficiency when the uncertainty 
on the activity of the users grows and the SNR is sufficiently large. We go one step beyond 
the application of the large-system decoupling principle [8], [9] and provide a new high-SNR 
analysis on the space of fixed-point solutions showing explicitly its interplay with the system 
load for a non-uniform ternary and parameter-dependent input distribution. By expanding the 
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minimum mean square error for large SNR, we obtain tight closed-form bounds that describe 
the large CDMA system as a function of the SNR, the activity factor and the system load. In 
addition, some trade-off results between these quantities are derived. Of special novelty here is 
the study of the impact of the activity factor in the CDMA performance measures (minimum 
mean-square error, and multiuser efficiency). In particular, we provide necessary and sufficient 
conditions on the existence of single or multiple fixed-point solutions as a function of the system 
load and SNR. Finally, we analytically identify the region of "meaningful" multiuser efficiency 
solutions with their associated maximum system loads, and derive consequences for engineering 
problems of practical interest. 

This paper is organized as follows. Section II introduces the system model and the main 
notations used throughout. Section III derives the large-system central fixed-point equation, and 
analytical bounds to the MMSE. Based on these results, Section IV discusses the interplay 
of maximum system load and multiuser efficiency. Finally, Section V draws some concluding 
remarks. 

II. System Model 

We consider a CDMA system with an unknown number of users [7], and examine the optimum 
user-and-data detector. In particular, we study randomly spread direct-sequence (DS) CDMA with 
a maximum of K active users: 

y t = SAb t + z t , (1) 

where y t G H N is the received signal at time t, N is the length of the spreading sequences, 
S G M ArxX is the matrix of the sequences, A = diag(ai, . . . , or-) G R KxK is the diagonal matrix 
of the users' signal amplitudes, b t = (b\, . . . , bf) G M. K is the users' data vector, and z t is an 
additive white Gaussian noise vector with i.i.d. entries ~ jV(0, 1). We define the system's activity 
rate as a = Prjuser k is active}, 1 < k < K. Active users employ binary phase-shift keying 
(BPSK) with equal probabilities. This scheme is equivalent to one where each user transmits a 
ternary constellation X = {— 1,0, +1} with probabilities Vx\b\ = — 1} = Pr{6^ = +1} = | 
and Pr{6f = 0} = 1 — a. We define the maximum system load as (5 = ^. 

In a static channel model, the detector operation remains invariant along a data frame, indexed 
by t, but we often omit this time index for the sake of simplicity. Assuming that the receiver 
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knows S and A, the a posteriori probability (APP) of the transmitted data has the form 

/, i r. a\ 1 \\y-SAb\\ 2 p(b) 

p(b\y, S, A) = —e — J) J (2) 
V2tt p{y\S,A) 

Hence, the maximum a posteriori (MAP) joint activity-and-data multiuser detector solves 

b = arg max p(b\y, S, A). (3) 

bex K 

Similarly, optimum detection of single-user data and activity is obtained by marginalizing over 
the undesired users as follows: 

b k = arg max^ p(b\y, S, A). (4) 



b\b k 

A. The decoupling principle 

In a communication scheme such as the one modeled by (2), the goal of the multiuser detector 
is to infer the information-bearing symbols given the received signal y and the knowledge about 
the channel state. This leads naturally to the choice of the partition function Z(y, S) = p(y \ S). 
The corresponding free energy, normalized by the number of users becomes [8] 

T K ± -±\np(y \ S) (5) 

To calculate this expression we make the self-averaging assumption, which states that the 
randomness of (5) vanishes as K — > oo. This is tantamount to saying that the free energy 
per user T K converges in probability to its expected value over the distribution of the random 
variables y and S, denoted by 

T± lim E (-llnp^lS)). (6) 

Evaluation of (6) is made possible by the replica method [11], [13], which consists of introducing 
n independent replicas of the input variables, with corresponding density p n (y\S), and computing 
J 7 as follows: 

T=- lim A ( lim 1 \nE{p n (y | S)}) . (7) 

To compute (7), one of the cornerstones in large deviation theorem, the Varadhan's theo- 
rem [20], is invoked to transform the calculation of the limiting free energy into a simplified 
optimization problem, whose solution is assumed to exhibit symmetry among its replicas. More 
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specifically, in the case of a MAP individually optimum detector, the optimization yields a fixed- 
point equation, whose unknown is a single operational macroscopic parameter, which is claimed 
to be the multiuser efficiency 1 of an equivalent Gaussian channel [9]. Due to the structure of 
the optimization problem, the multiuser efficiency must minimize the free energy. The above is 
tantamount to formulating the decoupling principle: 

Claim 2.1: [9], [12] Given a multiuser channel, the distribution of the output b k of the 
individually optimum (10) detector, conditioned on b k = b being transmitted with amplitude a, 
converges to the distribution of the posterior mean estimate of the single-user Gaussian channel 

y = Vib k + (8) 

where z ~ jV(0, 1), and rj, the multiuser efficiency, is the solution of the following fixed-point 
equation: 

rf l = 1 + /3E 7 [ 7 MMSE (777, a)] . (9) 
If (9) admits more than one solution, we must choose the one minimizing the free energy function 



J 7 = — E 



12ne If, 2tt\ 



p(y I b k ) mp(y \ b k )dy 

In (9), (10), p(y\b k ) is the transition probability of the large-system equivalent single-user 
Gaussian channel described by (8), and 



(b k - 



, 2 

k 



(ID 



MMSE(rn, a) = E 

denotes the minimum mean-square error in estimating b k in Gaussian noise with amplitude equal 
to yfi, where b k = E \b k \y\ is the posterior mean estimate, known to minimize the MMSE [21]. 

B. A note on the validity of the replica method 

The replica method is known to accurately approximate experimental data and is consistent 
with previous theoretical work [18], [22], [23]. The replica method analysis relies on four 
unproved assumptions: i) the self-averaging property of the free energy, ii) the replica symmetry 
of the fixed-point solution, iii) the exchange of order of limits and iv) the analytic continuation 
of the replica exponent to real values. Although the validation of the mathematical rigor of 
these assumptions is still an unsolved problem, there has been some recent progress in this 
direction [14], [24]-[26]. 

'The multiuser efficiency reflects the degradation factor of SNR due to interference [1]. 
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III. Large-system multiuser efficiency 

We illustrate here the behavior of multiuser efficiency and system load in the high-SNR region 
corresponding to detection with an unknown number of users. We start by shaping our problem 
into the statistical-physics framework [8], [9]. As mentioned earlier, the multiuser detector metric 
is regarded as the energy of a system of particles at state X. Therefore, the partition function 
Z(X) = X^ ex P ( — £ ( X )/T) corresponds to the output density given the channel information, 
i.e., p(y\S) = (2n)- 1 / 2 £ b p(b) exp (-\\y - SA 6|| 2 /2). 

The energy operator e(.), as derived from the free energy, is related to the logarithm of the 
joint distribution p(y | b, S)p(b): 

e(b) = \\y- SAbf -2 In p(b) (12) 

We can now invoke the decoupling principle (Claim 2.1) in the multiuser system (1), so as to 
use its single-user characterization. By doing this, the system's performance can be characterized 
by that of a bank of K scalar Gaussian channels (8), where K represents the maximum number 
of users. The input distribution for an arbitrary BPSK user k takes values X = { — 1, 0, +1} with 
probabilities |, 1 — a and f, respectively, the signal amplitudes from matrix A are assumed 
to be constant, i.e, a& = ^7 Vfc, where 7 is the SNR per active user (referred to as SNR), 
and the inverse noise variance is equal to the multiuser efficiency rj. Hence, rj is the solution 
of the fixed-point equation (9) that minimizes (10), where the MMSE is given by (11). More 
generally, the analysis presented in this paper can be easily extended to a k coefficients with 
different statistics, like for example those induced by Rayleigh fading. 

By applying Claim 2.1 [9] which holds under the assumptions of the replica method, the 
fixed-point equation of the user-and-data detector can be stated as follows: 

Corollary 3.1: Given a randomly spread DS-CDMA system with constant equal power per 
user, the large-system multiuser efficiency of an individually optimum detector that performs 
MAP estimation of users' identities and their data under BPSK transmission is the solution of 
the following fixed-point equation 

1 



V 



1 + 7 



v^^tt acosh(r;7— j/ v /»fy)+(l— a)e' 7 "J 



(13) 



that minimizes the free energy (10). 
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Figure 1. Large-system multiuser efficiency of the user-and-data detector under MAP with prior knowledge of a and /3=3/7. 

Proof: See Appendix A. ■ 
Our approach differs from that in [8], [9], [19], as the fixed-point equation (13) also includes 
the prior distribution on the users' activity in a static channel. Under MAP estimation, detection 
requires the knowledge not only of the prior information of the data, but also of the activity 
rate a. Thus, the fixed-point equations depend on MMSE, SNR, and system load. Numerical 
solutions vs. SNR at a load (3 = 3/7 are shown in Fig. 1. Plots like this one illustrate how the 
multiuser efficiency is affected by the level of noise and interference, and by the uncertainty 
in the users' activity rate. For low SNR, noise dominates, and the performance of the MMSE 
and the multiuser efficiency is degraded as a grows, since the presence of more active users 
adds more noise to the system. On the other hand, as we shall discuss later, for high SNR the 
MMSE strongly depends on the minimum distance between the transmitted symbols, and the 
activity rate here plays a secondary role. Hence, the gap between the multiuser efficiencies with 
a = 1 and a ^ 1 for larger SNR is due to the fact that the former constellation has twice 
the minimum distance of the latter. We can observe clearly the transition behavior from low to 
high SNR for values of a approaching 1. Moreover, when a = 1, (13) reduces to the fixed- 
point equation for the classical assumption, in which all users are active and transmit a binary 
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antipodal constellation [9]: 

v' 1 = i + P (i i - / ^ e_ " 2/2 tanh (^ - vVr/) d y ) • ( 14 ) 

In this case, it can be shown that, for high SNR, we have MMSE(t77, a — 1) « \j^ l erm ^ 2 - In 
fact, the following general result holds: 

Lemma 3.2: [28] For large output SNR, the MMSE of a system transmitting an equiprobable 
M-ary normalized constellation with minimum Euclidean distance d in a Gaussian channel with 
noise variance I/77 is 

MMSE(?n, « = 1) = /t(?n)e- d2,n/8 (15) 

with «i(?77) < ^(777) < /t 2 , where ^1(777) = 0(l/y/rpy) and « 2 is a constant, given by the 
maximum distance between neighboring symbols. 

For the entire range of activity rates, i.e., a e [0, 1], we can derive lower and upper bounds 
illustrating analytically the transition between the classical assumption (a = 1) and the cases 
where the activity is also detected (a < 1) for large SNR. Our calculations bring about a new 
analytical framework to deal with large-system analysis, as we will see in the next section. Our 
bounds are consistent with Lemma 3.2 and the lower bound includes the case a — 1. The general 
result is stated as follows. 

Theorem 3.3: The MMSE of joint user identification and data detection in a large system 
with an unknown number of users has the following behavior, valid for sufficiently large values 
of the product 777: 



V n vi V ^ 

Proof: See Appendix B. ■ 
Bounds in (16) describe explicitly, in the high-SNR region, the relationship between the 
MMSE, the users' activity rate, and the effective SNR (777). In Fig. 2 these bounds are compared 
to the true MMSE values as a function of 777 for fixed a. It can be seen that the uncertainty about 
the users' activity modifies substantially the exponential decay of the MMSE for high SNR. In 
fact, a value of a different from 1 causes the MMSE to decay by exp(— 777/8), rather than by 
exp(— 777/2), which would be the case when all users are active. Furthermore, we can observe 
that, for sufficiently large effective SNR, the behavior vs. a of the optimal detector is symmetric 
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with respect to a = 1/2, which corresponds to the maximum uncertainty of the activity rate. 
Figure 3 shows that for large values of the product 777, the MMSE essentially depends on the 
minimum distance between the inactivity symbol {0} and the data symbols { — 1, 1}, and thus 
users' identification prevails over data detection. Summarizing, the dependence of the MMSE 
must be symmetrical with respect to a = 1/2, since it reflects the impact of prior knowledge 
about the user's activity into the estimation. 




jo 7 i 1 1 i i 1 1 i i 

10 11 12 13 14 15 16 17 18 19 20 

rn(dB) 



Figure 2. A comparison of the exact MMSE value with its upper and lower bounds for a — 0.5 and 777 £ [10, 20] dB 



IV. Maximum System Load and Related Considerations 

Recall the definition of maximum system load (3 = ^, where K is the maximum number of 
users accessing the multiuser channel. When the number of active users is unknown, and there 
is a priori knowledge of the activity rate, the actual system load is f3' = a/3. In this section, we 
focus on (3 and study some of its properties. Notice that, given an activity rate, results for the 
actual system load follow trivially. 
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Figure 3. A comparison of the exact MMSE value with its upper and lower bounds for 777 = 20 dB and a 6 [0, 1]. 



A. Solutions to the large-system fixed-point equation 

We characterize the behavior of the maximum system load subject to quality-of-service con- 
straints. This helps shedding light into the nature of the solutions of the fixed-point equation (13). 
In particular, there might be cases where (13) has multiple solutions. These solutions correspond 
to the solutions appearing in any simple mathematical model of magnetism based on the evalu- 
ation of the free energy with the fixed-point method [11]. They represent what in the statistical 
physics parlance is called phase coexistence (for example, this occurs in ice or liquid phase of 
water at 0°C). In particular, at low temperatures, the magnetic system might have three solutions 
< ^i < ^2 < ^3 < 1- Solutions and are stable: one of them is globally stable 
(it actually minimizes the free energy), whereas the other is metastable, and a local minimum. 
Solution ty 2 is always unstable, since it is is a local maximum. The "true" solution is therefore 
given by and \T/ 3 , for which the free energy is a minimum. The same consideration applies 
also to our multiuser detection problem where multiuser efficiencies for the 10 detector might 
vary significantly depending on the value of the system load and SNR. More specifically, for 
sufficiently large SNR, stable solutions may switch between a region that approaches the single- 
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user performance (77 = 1 — ei) and a region approaching the worst performance (rj = e ), for 
< ei, e -C 1. Following previous literature [8], we shall call the former solutions good and the 
latter bad. When the solution is unique, due to low or high system load, the multiuser efficiency 
is a globally stable solution that lies in either the good or the bad solution region. Then, for given 
system parameters, the set of operational (or globally stable) solutions is formed by solutions 
that are part of these sets and minimize the free energy. 

The existence of good and bad solutions are critical in our problem. From a computational 
perspective, we are particularly interested in single solutions, either bad or good, that surely 
avoid metastability and instability. These solutions belong to a specific subregion within the bad 
and good regions, and appear for low and high SNR, respectively. From an information-theoretic 
perspective, it might seem that the true solutions should capture all our attention. However, it has 
been shown that metastable solutions appear in suboptimal belief-propagation-based multiuser 
detectors, where the system is easily attracted into the bad solutions region (corresponding to 
low multiuser efficiency), due to initial configurations that are far from the true solution [12]. 
Moreover, the region of good solutions is of interest in the high-SNR analysis, because, for a 
given system load, it can be observed that the multiuser efficiency tends to 1, consistently with 
previous theoretical results [22]. In what follows, we provide an analysis of the boundaries of 
the stable solution regions, as well as their computationally feasible subregions with practical 
interest in the low and high SNR regimes. 

A quantitative illustration of the above considerations is provided by plotting the left- and 
right-hand sides of (13) to obtain fixed points for constant values of amplitude and activity rate, 
and as a function of the system load. The solutions of (13) are found at the intersection of the 
curve corresponding to the right-hand side with the y — 77 line. Fig. 4 plots different solutions 
of the right-hand side of (13) for increasing system load, a = 0.5 and 7 = 18 dB: 

H/(7 ' r? ' a) = 1 + /3 7 MMSE(777, a) 
Notice first that the structure of the fixed-point equation in general does not allow the solution 
77 = 0, and for finite 7 and f3, rj — 1 is not a solution. In fact, the latter is an asymptotic solution 
for large SNR and certain system loads, as the MMSE decays exponentially to 0. From Fig. 4, 
one can observe the presence of phase transitions and the coexistence of multiple solutions. In 
particular, we observe that for /3 = 3/7 the good solution is computationally feasible. On the 
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0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 



Figure 4. Fixed-point solutions (marked by circles) for different values of j3 and fixed a = 0.5, and y = 18 dB. 

other hand, for (3 = 1 and /3 = 10 the system has three solutions, where the true solution belongs 
to either the bad or the good solution region. When the system load achieves (3 = 30, the curve 
only intersects the identity curve near 0, and the operational solution is unique and lies in a 
subregion of bad solutions. 

B. System load and the space of fixed-point solutions 

Even in the case of good solutions, the multiuser efficiency can be greatly degraded by the 
joint effect of the activity rate and the maximum system load. In order to analyze the fixed- 
point equation (13) from a different perspective and shed light into the interplay between these 
parameters, we express the maximum system load as the following function, derived from (13): 

T ^ a) - V1 MMSEtll,a) (17) 
Since MMSE is a continuous function of r] [10], then is also a continuous function in any 
compact set over the domain r\ G (0, 1] for given SNR and activity rate. It is also easy to 
observe that, for small values of 77, tends to infinity regardless of 7 and a, whereas in the 
high-77 region, which is of interest here, it decays to 0. Before analyzing the behavior of (17), 
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we introduce a few definitions that help describe the boundaries between the regions with and 
without coexistence (in the statistical-physics literature, these boundaries are called spinodal 
lines [8]). We also define appropriately the regions of potentially stable solutions as introduced 
before. 

Definition 4.1: The critical system load /3*(7, a) is the maximum load at which a stable good 
solution of (13) exists. 

Definition 4.2: The transition system load /3*(7, a) is the minimum load at which the true 
solution of (13), 77* coexists with other solutions 77^. 

Definition 4.3: The good solution region corresponds to the domain of (17) formed by the 
maximum 77 in every set of pre-images of below the critical system load: 



Similarly, the bad solution region corresponds to the domain of (17) formed by the minimum 77 
in every set of pre-images of above the transition system load: 



Fig. 5 illustrates (for fixed SNR and activity rate) and show the regions defined by the 
aforementioned parameters. It is important to remark that both system loads defined above delimit 
the regions from which there is phase coexistence < (3 < (3*) from the areas where there is 
one solution (J3 > f3* or (5 < /?*). Additionally, Fig. 5 illustrates the set of solutions that satisfy 
conditions (18), (19). 

Fig. 5 illustrates that it seems useful to define analytically the domain where stable solutions 
can be found. Beforehand, we differentiate for convenience the case with unknown number of 
users a G (0, 1), from the case where all users are active (a = 1). We do not consider the case 
a = 0. 

1) Case a G (0, 1): In order to analyze the conditions on the system load, SNR, and activity 
rate, for which we can find a good solution, we use the asymptotic results on the MMSE (16), 
yielding lower and upper bounds L(.) < Tg(7, 77,0;) < U(.) for large enough 777, where 



1Z 9 = {77 G [0, 1],77 = m a x{r/(P)},\/p G [0,/T]} 



(18) 



K b = {77 G [0, 1],77 = mm{T/(/?)}, V/3 G +00)} 



(19) 



L(7,77,a) 



A 



(I-U) 



(20) 



a/7T7?7q;(1 — a) 




(21) 
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Figure 5. System load function in the multiuser efficiency domain for a = 0.5 and 7 = 18 dB. 



Although not exact for low SNR, the dependence on rj of the upper and lower bound provides 
a good approximation for the dependence of Tg for large SNR and given a. Hence, by using 
U(.) and L{.), we obtain necessary and sufficient conditions that determine the regions of stable 
solutions and provide analytical expressions for the transition and critical system loads. The 
main result for a G (0, 1) follows: 

Theorem 4.4: Given the range of activity rates a G (0, 1), a necessary condition for phase 
coexistence is 

7 > 4(3 + 2V2), ( 7 >13.67dB) (22) 
Moreover, for high SNR, the condition is met and the transition system load is bounded by 

L(7, r] m , a) < &(7, a) < U (7, i] m , a) (23) 
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while the critical system load is bounded by 



(24) 



and rj m , r] M are given by 



Vm = 



( 7 /2 - 2 - 4A( 7 ))/ 7 



Vm = 



( 7 /2-2 + 4A( 7 ))/7 



where A (7) = ^(7/8)2 - 3 7 /8 + 1/4. 

Hence, the bad-solution region is given by 1Z b = (0,r] m ], whereas the good-solution region 
is TZ g = [tjm, !]• Similarly, the subregions of single bad solutions, that we shall denote R bc = 
(0,r] bc ) C 1Z b , and of single good solutions, denoted by R gc = (rj gc: 1] C lZ g , satisfy 



where r]\ c = min{U 1 (/?*)}, and rj* = max{L 1 (/?*)} are obtained from the bounds. 



The above result provides the general boundaries of the space of solutions of our problem. 
It is important to note that r\ m and r\ M are very good approximations for high SNR of the 
positions of the minimum and maximum observed in Fig. 5, which determine the transition and 
the critical system loads. As a consequence, remark that Theorem 4.4 analytically tells us the 
range of f3's for which there are either single or multiple solutions based on the up-to-a-constant 
approximation of by (20) and (21). Similarly, rf hc and rf gc are tight bounds of the boundaries 
of the single-solution regions as U(.) and L(.) are of T /3 (.). Note also that the activity rate 
affects the boundaries in the same symmetrical manner as it does the MMSE (i.e., the worst 
case here also corresponds to a = 0.5) but has no impact on the operational region, that is only 
reduced in size by increasing the SNR. In particular, these regions are characterized, in the limit 
of high SNR, as follows: 



Corollary 4.5: In the limit of high SNR, lZ g — > {1}, lZ b — > {0}, and consequently lZ gc — > {1}, 
and TZ bc ->• {0} . 



Vbc = min{T/(/?*)} > < c 
r] gc = maxm 1 (/?*)} < rf gc 



Proof: See Appendix C. 
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Proof: The above corollary results from 

r (7/2-2 + 4^(7/8)^-37/8 + 1/4) 
hm i] M = lim = 1 

7^00 7^00 7 

Umfc = |im (7/2-2- VPFg; 1/4) =Q 

7^00 7^00 7 



Note that, given a system load /3 with (3* > (3, for sufficiently large SNR the unique true (large- 
system) solution is rj = 1, which corroborates the main result in [22]. Moreover, the description of 
the feasible good solutions by analytical means allows the computation of a sufficient condition 
on the system load to guarantee a given multiuser efficiency in practical implementations. More 
specifically, we use the aforementioned lower bound on T to state that any system load below 
L(.) guarantees that the given multiuser efficicency is achieved. The result is stated as follows: 

Corollary 4.6: The maximum system load, (3 a ^, for a given activity rate and multiuser ef- 
ficiency requirement, rj — 1 — e, where < e « 1, that lies in R gc , is lower-bounded in the 
high-SNR region by 

> - £ e^l*. (25) 

y 7r?77«(l — a) 

In Fig. 6 we show the numerical values of the transition and the critical system load as 
a function of the SNR in the (7, (3) space. We also use the asymptotic expansion to derive 
upper and lower bounds, respectively. The plotted curves are the spinodal lines, which mark 
the boundary between the regions with and without solution coexistence. The (lower branch) 
separates the region where the bad solution disappears, whereas f3* (upper branch) contains the 
bifurcation points at which the operational solution disappears. The intersection point between 
both branches corresponds to the SNR threshold (22), which provides the necessary condition 
for solution coexistence. 

2) Case a — 1: We now apply the same reasoning for the "classical" approach to multiuser 
detection, corresponding to activity rate 1. In this case, using the approximation in [28], the 
system load function can be lower-bounded by 

(1-n) (l-n)e rn/2 

T ^ 1) = ps|p) <L ^- <26) 

Hence, we can derive the following spinodal lines 
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Figure 6. Upper and lower bounds on the numerical spinodal lines (thick line) for a — 0.5. 



by 



Corollary 4. 7: Given a = 1 a necessary condition for the phase coexistence is that 

7^3 + 2^, (7>7.65dB). 
Moreover, for high SNR, the condition is met and the transition system load is upper-bounded 

(1 - Vm' 



7T v m ii 



Vm'l 



-e 2 



and the critical system load is upper-bounded by 



0* < 



Vm'1 



e 2 



(27) 



(28) 



where r\ m i and r\ M ' are given by 



a (7/2 - 1/2 - A( 7 )) 

Vm' = 



7 



( 7 /2-l/2 + A( 7 )) 

7 



and A (7) = v/( 7 /2) 2 - 3 7 /2 + 1/4. 
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Hence, the bad solution region is given by 1Z b = (0, r} m i] whereas the good solution region is 

Kg = [Vm', 1]. 

Proof: The proof is analogous to that of Theorem 4.4. ■ 
The same consequence for the asymptotic operational region holds here. 
Corollary 4.8: In the limit of high SNR, TZ g -+ {1}, and TZ b -+ {0}. 

Proof: This corollary results from 

r r (7/2-1/2 + y/( 7 /2) 2 - 37/2 + 174) 
hm t]m = lim = 1 

7— >oo 7— >oo 

lim = lim (7/2 -1/WW2)'- 3V2 +1/4) = „ 

7— >oo 7— >oo 




Figure 7. Comparison of upper bounds on the spinodal lines for a = 1.0 (left) and a — 0.5 (right). 

In Fig. 7, one can observe a 6 dB-difference between the spinodal lines corresponding to 
a = 0.5 and to a = 1.0. This is due to the minimum distance of the underlying constellations, 
which causes the MMSE to have different exponential decays. This can be interpreted by saying 
that the addition of activity detection to data detection is reflected by a 6 dB increase of the 
SNR needed to achieve the same system load performance. Moreover, with a < 1, the transition 
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system load is lower than the case where all users are active, and, therefore, computationally 
good solutions correspond to lower values of the maximum system load. 

C. Maximum system load with error probability constraints 

A natural application of the above results to practical designs appears when the quality-of- 
service requirements of the system are specified in terms of uncoded error probability. Such 
an application can provide some extra insight into the plausible values of j3 with joint activity 
and data detection for efficient design of large CDMA systems. Once a multiuser-efficiency 
requirement is assigned, the corresponding probability of error follows naturally. Note first that, 
in order to detect the activity as well as the transmitted data, our model deals with a ternary 
constellation { — 1, 0, 1}. When any of these symbols is transmitted by each user with constant 
SNR= 7 through a bank of large-system equivalent white Gaussian noise channels with variance 
l/rj, the probability of error over X depends on the prior probabilities as well as the Euclidean 
distance between the symbols. The error probability implied by the replica analysis is 



P e (r,, 7) a) = 2(1 - a)Q [ ^ + A= ) + aQ ( ^ - ) (29) 

2 y/TfJ V 2 y/rfjj 



where Q(x) = ^= e~^dt is the Gaussian tail function, and X a = In ^ 1 ~"' > j • 

The relationship between 77 and P e for our particular case can be used to reformulate the 

bounds on the function in terms of error probability. 

Corollary 4.9: The maximum system load, Tp(rf, 7, a), for a given error probability P e , 7, 

and activity rate is bounded for high SNR by: 

L(>y,r) max ,a) < ^(7^,7, a) < r} m!a , a) (30) 

where 

W = max{?7p,77 gc } , 

and (?7p,7, a) is the pre-image of P e . 

Proof: The result is obtained by noticing that the multiuser efficiency requirement extracted 
from P e must lie on the subregion (r] gc , 1]. ■ 

Notice that, if the error probability satisfies i] p < i] gc = i] max , then the constraint is described 
by the bounds on the transition load (24). However, if r\ gc < r\ v = r] max , then, for Corollary 4.6, 
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the maximum system load can be also easily bounded. Fig. 8 plots the critical system load for 
two different error probabilities requirements and three different activity rates. 




10° 

15 15.5 16 16.5 17 17.5 18 18.5 19 19.5 20 

7 (dB) 



Figure 8. Critical system load for different uncoded error probabilities and activity rates. Thicker lines represent numerical 
results, whereas regular lines show the corresponding lower bounds. Lines with circle markers: P e — 10~ 3 and a — 0.99. Lines 
with cross markers: P e — 10 -3 and a — 0.1. Lines with star markers: P e — 10~ 3 and a — 0.5. Lines with square markers: 
error probability 10 -5 and a = 0.5. 

V. Conclusions 

We have analyzed multiuser detectors for CDMA where the fraction of active users is unknown, 
and must be estimated in a tracking phase. Using a large-system approach and statistical-physics 
tools, we have derived a fixed-point equation for the optimal user-and-data detector, and provided 
asymptotic bounds for the corresponding MMSE. Further, we have described the space of stable 
solutions of the fixed-point equation, and derived explicit bounds on the critical and transition 
system loads for all users' activity rates. These are consistent with the results obtained under 
the classic multiuser-detection assumption (a = 1.0) made in the literature. The study of the 
so-called spinodal lines allowed us to determine the regions of stable good and bad solutions, 
including subregions of single solutions (also computationally feasible), in the system load vs. 
SNR parameter space of our model. Our results show that for a user-and-data detector, the 
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boundaries of the space of solutions do depend on the activity rate, whereas the regions of 
stable solutions (good and bad) are only affected by the SNR. Hence, the overall system load 
performance keeps a symmetric behavior with respect to a. In practical implementations with 
high quality-of- service demands, we are interested in maximizing the critical system load, while 
keeping the optimal detector in the feasible subregion of good multiuser efficiencies, such that a a 
wider range of potential users can successfully access the channel with a given rate. By increasing 
the SNR, this goal can be achieved, but for limited SNR, the certainty on the users' activity 
allows allocation of more users for a given spreading length. A relevant example corresponds 
to a system with a given error probability requirement. For this case, we have shown that, 
for sufficiently large SNR, we can choose the minimum multiuser efficiency in the domain of 
feasible good solutions, and maximize the critical system load regardless of the error probability 
target. 

One of the assumptions of this paper is to model the activity as an i.i.d. process. Further 
extensions of this work to non-i.i.d scenarios can be found in [5] where the users' activity 
evolves according to a Markov process and in [29], where users transmit encoded messages and 
the activity is correlated over the coded blocks of each user. 



We first derive the MMSE for our particular ternary input distribution in the general fixed-point 
equation (9): 



Appendix A 



Proof of Corollary 3.1 





a cosh(r)y' yfiy) + (1 — ot)e 2 



e-I^'+V7)Vsinh(?7y'^/7) 



dy 



dy' 



After appropriate change of variables 
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the MMSE is 



MMSEfrn a)=a- f —e^ ^ sinh[ V1 - y^] 

Since the SNR is constant among users, it follows naturally that the large-system fixed-point 
equation is given by (13). 



Appendix B 
Proof of Theorem 3.3 

From now on, we omit the explicit indication of the arguments of the MMSE function. The 
lower bound is obtained by noting that, for large SNR, the general MMSE, denoted MMSE Q , is 
lower-bounded by MMSE{ ,i}, which describes the detection performance when the transmitted 
symbols are {0, 1}, with probabilities {1 — a, a}. In this case the MMSE has the following form 

where A Q = \ In (^) . After some manipulation and appropriate changes of variables, we obtain 

MMSE {0>1} = a - ae~'^r- Xa J— f e ~^ {2z ~" /Wi+2 ^ ? sech (zy/fjfy) dz. 
Use now the following asymptotic expansion for sech(z): \z\ — > oo 



MMSE{ ,i} =a-J ^ (ae -^ + (1 _ a)e -^ 



sech(z) = 2e- |z| ( 1 + ^(-l) £ e 

and obtain 



2£| Z | 



MMSE {0il} = a - ae ~ Xa \j — 



»oo / oo \ 



We now use the expansion 

Ho,i} 



MMSEm n = a- ae~ ,?7/8+A ^^ 



e=o V n 

®® I c\ /*00 / \ 
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Express now the integrals in terms of the Q-function, = ^7= e~^dt 



MMSE{ 0)1 } = ae 



-m/8+\ a - 



( VJP 2Aq \ 
\ 2 ^Tri ) 



2 



e 2 Q 



VI 2A a 



— e 



Q 



-D-d 



£=1 



, 2 



+ e~ 



' (3+21)^ 2A Q A 2 
2 y^rry 



(3 + 2£)^7 2 A 



Next, use the expansion of the Q function, [1]: 



Q(x) 



2 /2 / OO^ 

£_ l + yv-i) 



-nu^- 1 )' 



2f ; 



(3D 



to obtain 

MMSE {0>1} = 2 1 



'a(l — a) 

27T777 



+ 



fl_4A^\ fl + IA^A ( 3 _4A^ (3+^ 
V ^7 / V T J \ VI J \ VI J 

+ ■■■ + 



VI 

where the linear term in A Q is substituted in the common factor. Assuming a large value 777, 
and using the result 



n=0 



-1 



ira+1 



7T 



2n + 1 



we obtain the following lower bound 
MMSE {0 ,i} > 2 



a(l — a) 
2 77777 



e~^ /8 V2 = 24 



77777 



As far as the upper-bound is concerned, we derive the general MMSE, denoted MMSE a , and 
its particular case when all users are assumed to be active, denoted MMSE^ Hence, we express 
the corresponding integrals in an analogous manner 



(a 

Ci 



1 -(y-Vv 7 ?) 2 

— e 2 



asinh(y v /777) 



27r a cosh(y ^/rfy) + (1 — a)e v 2 

1 -(y-VWi) 2 



dy. 



2tt 



tanh(yy/rfy)dy. 
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We now obtain 

MMSE a = a(l - C Q ) = a (1 + Ci - Ci " Ca) = «((!" Ci) + (Ci - Ca)) 
= a(MMSE 1 + (Ci-C«)) 
Next, we expand a(Ci — Ca), which yields 

«(C, -« = (!- <*K"' 2 / > -^M- -Ay 

J \Z2n a cosh [yy/rfy] + (1 — a)e r i"'/ 2 cosh(y y/rpy) 

= (1 - a)e-/ 2 / J= ta^%^^ 

i cosh^^n] + e^ /2+ln (^) 

Consider now the following inequalities 

tanh(z) < 1 and cosh(z) > — 
After substitution and manipulation of the denominator of (32), we obtain 



a 



(Ci - Ca) <(1 - aK 7/2 / TT^rdy 



(l-aje^/ ^= ' ' 4 s- dy, 



-oo cosh (^Z - Y - 0a) 

where a = \ In ^ 1 ~ Q ^ . We readjust terms to express the integral in a convenient form 



, 2 

. y- 



We now use the following transformation in the variable of integration: y = 2z + +P + 





« (Ci - Ca) <2(1 - a)e^-* a / ^ sech (2^777) d5 

./-co V27T 



-oo 

-( 2 z+^ N 

oo -V ^2/ 



+2(1 - a)e~ ,?7/8 -^ / ^= sech ( V?n) 

V2tt 



o 



and the asymptotic expansion for sech(z) in the above derivation 



'OO 



sech(z) = 2e Hz| 1 + ^(-1)V 



■2t\z\ 
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This yields 

a(Ci-C«) <4(l-a)e-^ /8 - 



£(-u 



+ 4(1 - a)e~ , ' 7/8 -^-^ 



£=0 



-2i 2 + ((l+2^)VW-^)i 

= 



2tt 



Finally, expressing the integrals in terms of the Q function 



a (Ci - C«) < 2(1 - a)e-" 7/8 -^-^ 



£=0 

+£(-i)V 



'(1+21)^ 2fe 2\ 2 



L_/(l + 2^)^/777 20 Q 



(l+2£)y^7 , 20 o 



Q 



and manipulating the expansion 

a(Ci-C«) <2(l-a)e-^ /8 -^- 



777 



~^ ^) Q ( vn 



+ e" 



2 

. 2 iz^L Q {(i + 2t)VWy 20. 



2 + v / ^y | / (1 + 2£j v /?77 20 a \ 



£=1 



we obtain, after using the series expansion (31), 

a(Ci-Ca)<2W^^e-^/ 8 1 



+ ••• + 



where the linear term in <p, 
terms are neglected. 

Using the same result as before on the series 2 Y^=o 



V r r/ J V t / \ t / \ 777 / 



I i n ^ 2 ( 1 ^") j is substituted in the common factor, and quadratic 



1 2n ; +1 , we obtain the upper bound: 



a 



K. - CO < 

V ^7 
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Finally, using the upper bound given in Lemma 3.2 for BPSK, the overall MMSE can be upper- 
bounded by 



MMSE Q < 2ae^ + . H 1 ~ a) e -^«. 

V vi 

Appendix C 
Proof of Theorem 4.4 



We analyze the function 



G(rj) = {l-rj)e^/y/rj (33) 



where u is a constant, which entirely describes the dependence of on rj for sufficiently large 
777. By simple derivation of (33), it is easy to observe that the solution has critical points in the 
domain (0, 1] if and only if u > (3 + v / 8)/2. These points are 

u - 1/2 - y/u 2 -3u + l/4 



Vr, 



2u 



U-1/2 + ^m 2 - 3m + 1/4 
VM = 2u 

and lie in the domain (0, 1]. In fact, note that u 2 — 3u + 1/4 < (u — 3/2) 2 , and thus it can 

be verified that < l/2u < rj m < rjM < 1 — 1/u < 1. By using the second derivative 

of (33) we observe that these solutions correspond to a local minimum and a local maximum, 

respectively. Let us now study the function (33) to justify the range of values of the critical 

system load. G(rj) is a continuous function in (0, 1] that takes positive values. Since G{rj) 

tends to as rj approaches 1, and tends to infinity as rj approaches 0, it can be concluded that 

the range for which G(rj) has only one pre-image is (0,G(r) m )) U (G(r] M ), 00). Hence, there 

are single pre-images in the ranges (0, min{G _1 (G'(r/M))}) and (max{G~ 1 (G(?7 m ))}, 1]. For 

G(rj m ) < G(.) < G(t}m), there are three pre-images and for G(rj m ) and G(r] M ) there are exactly 

two due to the local minimum and maximum (See Fig. 5). Then, the smallest pre-image among 

them lies on [min{G' _1 (G r (r/M))}, Vm] whereas the largest lies on [r] M , max{G _1 (G r (?7 m ))}]. In 

conclusion, the overall smallest pre-images belong to 

7L X = (0,min{G'- 1 (G'(r ?M ))}) U [min{G'- 1 (G'(r ?M ))}, Vm ] = (0, Vm \, (34) 

whereas the largest pre-images belong to 

U 2 = [7 ?M ,max{G- 1 (G'(7 ?m ))}] U [max^" 1 ^^))}, 1] = [m, !]• 
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In particular, K 12 = (0,min{G-\G(ri M )}) C ll x and TZ 22 = (max{G'- 1 (G'(r? m ))}, 1] C K 2 . By 
bounding the MMSE using (16) and replacing u — 7/8, we obtain the desired results. 

References 

[1] S. Verdu, Multiuser Detection. Cambridge University Press, UK, 1998. 

[2] K. Halford and M. Brandt-Pearce, "New-user identification in a CDMA system," IEEE Trans. Commun., vol. 46, no. 1, 
pp. 144-155, Jan. 1998. 

[3] T. Oskiper and H. V. Poor, "Online Activity Detection in a Multiuser Environment Using the Matrix CUSUM Algorithm," 

IEEE Trans. Inform. Theory, vol. 48, no. 2, pp. 477^493, Feb. 2002. 
[4] B. Chen and L. Tong, "Traffic- Aided Multiuser Detection for Random- Access CDMA Networks," IEEE Trans. Sig. 

Process., vol. 49, no. 7, pp. 1570-1580, July 2001. 
[5] E. Biglieri, E. Grossi, M. Lops, and A. Tauste Campo, "Large-system analysis of a dynamic CDMA system under a 

Markovian input process," in Proc. IEEE Int. Symp. Inform. Theory, Toronto, Canada, July 2008. 
[6] M. L. Honig and H. V. Poor, "Adaptive interference suppression in wireless communication systems," in Wireless 

Communications: Signal Processing Perspectives. 1998, H.V. Poor and G.W. Wornell, Eds Englewood Cliffs, NJ: Prentice 

Hall. 

[7] E. Biglieri and M. Lops, "Multiuser detection in a dynamic environment- Part I: User identification and data detection," 

IEEE Trans. Inform. Theory, vol. 53, no. 9, pp. 3158-3170, Sept. 2007. 
[8] T. Tanaka, "A statistical-mechanics approach to large-system analysis of CDMA multiuser detectors," IEEE Trans. Inform. 

Theory, vol. 48, no. 11, pp. 2888-2910, Nov. 2002. 
[9] D. Guo and S. Verdu, "Randomly spread CDMA: Asymptotics via statistical physics," IEEE Trans. Inform. Theory, vol. 

51, no. 6, pp. 1983-2007, June 2005. 
[10] D. Guo, Y. Wu, S. Shamai (Shitz) and S. Verdu, "Estimation in Gaussian noise: Properties of the minimum mean-square 

error," Submitted to IEEE Trans. Inform. Theory, http://arxiv.org/abs/1004.3332. 
[11] H. Nishimori, Statistical Physics of Spin Glasses and Information Processing: An Introduction, Oxford Univ. Press, 

Oxford, UK, 2001. 

[12] D. Guo and T. Tanaka, "Generic multiuser detection and statistical physics," in Advances in Multiuser Detection. M. L. 

Honig (Ed.). John Wiley & Sons, 2009. 
[13] M. Mezard and A. Montanari, Information, Physics and Computation, Oxford Univ. Press, 2009. 

[14] S. B. Korada and N. Macris, "Tight bounds on the capacity of binary input random CDMA," Accepted for publication in 

IEEE Trans. Inform. Theory, http://people.epfl.ch/satish.korada. 
[15] A. Tauste Campo and E. Biglieri, "Large-system analysis of static multiuser detection with an unknown number of users," 

in Proc. of IEEE Int. Workshop on Comp. Advances in Multi-Sensor Adapt. Process. (CAMSAP'07), Saint Thomas, US, 

Dec. 2007. 

[16] A. Tauste Campo and E. Biglieri, "Asymptotic capacity of a static multiuser channel with an unknown number of users," 

in Proc. IEEE Int. Symp. on Wir. Per. Mult. Comms. (WPMC'08), Sept. 2008. 
[17] E. Biglieri and M. Lops, "A new approach to multiuser detection in mobile transmission systems," in Proc. IEEE Int. 

Symp. on Wir. Per. Mult. Comms. (WPMC'06), San Diego, CA, Sept. 2006. 
[18] D. Tse and S. Hanly, "Linear multiuser receivers: effective interference, effective bandwidth, and user capacity," IEEE 

Trans. Inform. Theory, vol. 45, no. 2, pp. 641-657, Mar. 1999. 



October 11, 2010 



DRAFT 



28 



[19] R. R. Mller, "Channel capacity and minimum probability of error in large dual antenna array systems with binary 

modulation," IEEE Trans. Sig. Process., vol. 51, no. 11, pp. 2821-2828, Nov. 2003. 
[20] R. S. Ellis, Entropy, Large Deviations, and Statistical Mechanics, vol. 271, A series of comprehensive studies in 

mathematics. Springer- Verlag, 1985. 
[21] V. Poor, An introduction to Signal Detection and Estimation, Springer- Verlag, New York, 1988. 

[22] D. Tse and S. Verdu, "Optimum asymptotic multiuser efficiency of randomly spread CDMA," IEEE Trans. Inform. Theory, 

vol. 46, no. 11, pp. 2718-2722, Nov. 2000. 
[23] S. Verdu and S. Shamai (Shitz), "Spectral efficiency of CDMA with random spreading," IEEE Trans. Inform. Theory, vol. 

45, no. 2, pp. 622-640, Mar. 1999. 
[24] M. Talagrand, Spin Glasses: A Challenge for Mathematicians, Springer, 2003. 

[25] A. Montanari and D. Tse, "Analysis of belief propagation for non-linear problems: The example of CDMA (or: How to 

prove Tanaka's formula)," in Proc. IEEE Inform. Theory Workshop, Punta del Este, Uruguay, Mar. 2006. 
[26] D. Guo and C.-C. Wang, "Random sparse linear systems observed via arbitrary channels: A decoupling principle," in 

Proc. IEEE Int. Symp. Inform. Theory, Nice, France, June 2007. 
[27] D. Guo, D. Baron and S. Shamai (Shitz), "A single-letter characterization of optimal noisy compressed sensing," in Proc. 

Allerton Conf Commun. Control, and Computing, Oct 2009. 
[28] A. Lozano, A. M. Tulino, and S. Verdu, "Optimum power allocation for parallel gaussian channels with arbitrary input 

distributions," IEEE Trans. Inform. Theory, vol. 52, no. 7, pp. 3033-3051, July 2006. 
[29] A. Tauste Campo and A. Guillen i Fabregas, "Large System Analysis of Iterative Multiuser Joint Decoding with an 

Uncertain Number of Users," in Proc. IEEE Int. Symp. on Inform. Theory, Austin, Texas, June 2010. 



October 11, 2010 



DRAFT 



